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ABSTRACT 

We investigate the impact of active /earning techniques, specifically experiment based learning , in a Principles of 
Economics doss. Our case study demonstrata that u4sen using pedagogical techniques intended to facilitate active 
learning * teaclsers should be intentional about incorporating components of learning that appeal to students with dif¬ 
ferent learning preferences and demographic characteristics. Drawing upon an earlier study by Emerson and Taylor 
(2005) we explore the effectiveness of alternative teaching methods conditional upon their learning style preferences , 
race and gender. Wefind no significant evidence of gains in learning outcomes from a single case study ofexperiment 
based learning. We conclude that experiment based learning as a pedagogical too! is most effective when it is adopted 
as rise dominant teaching/learning strategyfor an entire course. Repeated participation in experiment based learning 
has the potential tofoster strategic thinking and provides catch-up opportunities for different groups ofstudents. The 
use of experiment - based learning as an occasional teaching tool, while engaging students in the classroom , does not 
appear to translate into significant learning gains. 


INTRODUCTION 

Several studies in the area of economic education have 
demonstrated the need for and the effectiveness of active 
teaching/learning techniques in the classroom 1 . As a re¬ 
sult various active pedagogical tools such as experiments* 
cooperative learning and class discussions have been ad¬ 
opted in Economics classrooms. The efficacy of these 
teaching techniques have been tested against measures of 
learning such as Test of Understanding in College Eco¬ 
nomics (TUCE Scores) 1 and course grades 5 . 

A significant number of studies in this area have demon¬ 
strated that measured learning outcomes measured arc im¬ 
proved specifically by the implementation of experiments 
in the classroom. 'Classroom Experiments arc activities 
where any number of students wodc in groups on carefully 
designed guided inquiry questions. Materials provide stu- 


1 Becker (1997) and Emerson and Taylor (2004) 

2 Wetzel ct al (1982) and Emerson and Taylor (2004* 
2007) 

3 Borg and Shapiro (1996) and Borg and Stranahan 

( 2002 ) 


dents with the means of collecting data through interac¬ 
tion with typical laboratory materials* data simulation 
tools or a decision making environment* as well a series of 
questions that lead to discovery based learning' (Starting 
Point: Teaching and Learning Economics). 

However, subsequent studies found that learning gains 
were not equal across all student groups. The literature in 
this area investigated student performances across learn¬ 
ing and personality types. Zicgcrt (2000) incorporated 
both student and faculty personality temperaments as 
per the Mycrs-Briggs personality type indicator (MBTI) 
to study its impact on course grade and TUCE scores. 
They find that personality type does affect student per¬ 
formance with implications for the "gender gap" in eco¬ 
nomics. Emerson and Taylor (2007) combine these two 
strands of literature to research the impact of personality 
types in conjunction with teaching methodology* i.c. tra¬ 
ditional lecture based versus experiments based, on stu¬ 
dent achievements measured by the TUCE score in the 
course. They largely find that the learning gains associated 
with experiment based teaching methods arc widespread 
across most personality types and that the "gender gap" 
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in economics disappears when controlled for personality 
types. 

Even as the pedagogical literature shows evidence of the 
benefits of experiment based learning, universities and 
colleges face increasing resource constraints requiring in 
some cases, curriculum standardization across introduc¬ 
tory Economics classes. A standardized curriculum may 
also be needed to facilitate the program needs jor. the flex¬ 
ibility of instructors to adopt active learning demand for 
the Business major of a growing cohort of Business ma- 
jorsVlhc above developments have required instructors to 
teach larger classes to an increasingly diverse student body 
and at the same time teach a broad portfolio of courses. 
Our mid-sized Midwestern University, for instance, is a 
private university that has followed a model of small class 
sizes that maximize student-teacher interaction and is 
now planning for enrollment growth. Additionally, faced 
with the constraint of conforming to a standardized cur¬ 
riculum, instructors could be hampered by lack of time in 
incorporating active learning techniques, such as experi¬ 
ments, in their classrooms'. Further, while earlier studies 
have demonstrated gains in learning outcomes from ex¬ 
periment based learning, these gains in learning outcomes 
were measured through comprehensive testing at the 
end of a semester. For instance, the Emerson and Taylor 
(2004. 2007) findings arc based upon a series of eleven 
experiments that were conducted over an entire semester. 
We investigate whether experiments could be strategically 
used as a teaching technique within a traditional lecture 
based class to reinforce understanding of key concepts. 


4 According to the National Center of Education Sta¬ 
tistics. in 2010. one-fifth of graduating students arc 
Business majors and the percent of Bachelors de¬ 
grees conferred by degree granting institutions has 
increased by 32% over the period 2O0O-2010.by Bu 

5 Becker and Watts (2001) find from a national survey 

of American institutions of higher learning in 2000 
that in four types of undergraduate Economics 
courses (Principles or Introductory. Intermediate 
Theory or Upper Level. Statistics and Econometrics 
and other Upper-Division courses), though instruc¬ 
tors spend more time teaching, the typical instruc¬ 
tor continues to be a person “who lectures to a class 
of students as he writes text, equations or graphs 
on a chalkboard, and who assigns students reading 
from a standard textbook*. Becker coined the term 
“chalk and talk" for this type of teaching and finds 
that the median time spent lecturing in all courses 
in all institutions is 83%. 


We propose to build upon Emerson and Taylors (2007) 
study to answer the following questions: 

• Arc there gains from experiment based learning 
when the constraints of a common curriculum 
limits the ability of the instructor to adopt active 
learning techniques? In other words, is an active 
learning technique equally effective when the dom¬ 
inant teaching style is traditional-lecture based, 
interspersed with a few* active learning modules? 

• Arc there differential crimcnt based learning per- 
sista across race and gender? is one that 

• s dominated by g. gains from experiment based 
learning across learning styles and do they persist 
across race and gender? 

We, therefore, measure learning performance by testing 
students on learning outcomes from a single experiment 
instead of an overall course assessment. This study is an 
improvement on an earlier paper wherein we compared 
mean differences in learning outcomes between the exper¬ 
iment and control groups. In this study, a similar compari¬ 
son is made subsequent to controlling for student char¬ 
acteristics pertaining to gender, race, ability and learning 
preferences. We also investigate whether female and non¬ 
white learners experience differential learning gains rela¬ 
tive to male and white students, in an experiment setting. 

Learning style of students is identified using the VARK 
(Fleming, 1995) or Visual-Auditory-RcadWritc- Kines¬ 
thetic 4 5 6 method. This technique identifies student learning 
preference directly unlike the MBTI Indicator method 
where personality type is used to draw inferences about 
the learning style of the student The VARK methodology 
was developed to identify the ways by which individuals 
prefer to receive and/or impart information. This method 
of identifying learning styles was developed solely to as¬ 
sist with optimizing the information intake and commu¬ 
nication experience of learners and docs not account for 
their personality types, physical and social environment. 
While these other factors also impact learning ability, in 
focusing specifically on the best method by which stu¬ 
dents prefer to learn, it enables us to determine the best 
method of communication in the classroom. Bcrnardcs 
and Hanna (2009) use VARK methodology and find that 
while student learning styles vary by student gender, they 
arc invariant by student major. The study by Boatman. 
Courtney and Lee (2008) uses the VARK methodology 
and finds that students with a visual learning preference 
perform better in an Introductory Economics Course. 
Their findings, however, do not factor in the teaching 


6 See Appendix A for a description of each of the 
VARK learning style preferences. 


methodology used by the instructors. Emerson and Taylor 
(2007) combine these two strands of literature to research 
the impact of personality types in conjunction with teach¬ 
ing methodology, i.c. traditional lecture based versus ex¬ 
periments based, on student achievements measured by 
the TUCE score in the course. They find that the learning 
gains associated with experiment based teaching methods 
arc widespread across most personality types and that the 
“gender gap* in economics disappears when controlled for 
personality types. 

DATA 

Students in our study were enrolled in one of three sec¬ 
tions of the Principles of Economics: Macro course and 
one section of the Principles of Economics: Micro course 
at the University during the 2013 spring semester. The 
micro section consisting of 28 students was the control 
group, while the three macro sections, consisting of 84 
students, was the experiment or treatment group. Stu¬ 
dents at VU use the same textbook for both the micro 
and macro portions of the course and the first 5 chapters 
of both these courses arc identical in content. The experi¬ 
ment chosen for this study pertained to a topic from one 
of these five chapters with rdcvancc for both courses. 

The control group was taught using the traditional lecture 
based method of instruction. Information on student 
characteristics were obtained from an informed and vol¬ 
untary consented survey approved by the Institutional 
Review Board of Valparaiso University (VU). We clas¬ 
sified students into learning style preferences by scoring 
and classifying responses to a questionnaire designed by 
Fleming (1995). Classification of students by major, year, 
race, gender and learning style arc presented in Table 1. A 
limitation of small sample size is chat there is some hetero¬ 
geneity across sections in terms of sub-sample distribution 
by student characteristics, as evident from Table 1. a factor 
to keep in mind while analyzing learning outcomes. 

The experiment information sheet and design for each 
section was identical. After the experiment was com¬ 
pleted. we compared learning outcomes by handing out 
a questionnaire on concepts pertaining to the topic. We 
chose this format to lower grading time in contrast to our 
earlier study (Raman and Dcvaraj. 2012) where the for¬ 
mat w’as one of short response questions. 

EXPERIMENT DESIGN AND ASSESSMENT 

The concept illustrated using the experiment method was 
public goods as a special case of market failure. Our Prin¬ 
ciples of Economics classes arc largely taught within the 
framework of a market capitalist economic system. Stu¬ 
dents arc taught that the "invisible hand framework" of 


a competitive market leads individuals to make voluntary 
choices that arc in their ow n and ultimately society’s in¬ 
terest. This is an idea that the largely conservative students 
at our university find ideologically appealing. Moreover, 
this concept is continuously reinforced in many Econom¬ 
ics and Business classes as it forms the theoretical basis of 
many economic models. However, as the debate on the 
role of government in a market economy intensifies both 
within the Economics discipline and in the popular press, 
we feel that it is imperative that students be aware that 
the markets could fail when individual decisions do not 
lead to socially desirable outcomes. Therefore, we made a 
strategic choke to adopt an experiment based approach to 
demonstrate to students that market failure, and specifi¬ 
cally public goods, is cause for government intervention 
to improve social efficiency. A public good is one that is 
nonexclusive, i.c.. that no one can be excluded from its 
benefits and non-rival, i.c.. consumption by one does not 
preclude consumption by others. Once a pure public good 
is supplied to one individual, it is simultaneously supplied 
to all whereas a private good is only supplied to the in¬ 
dividual who bought iL This gives rise to the free rider 
problem where the individual can benefit from the good 
without paying for it. Under these conditions, the com¬ 
petitive market w’ill either fail to provide or underprovide 
the good relative to the socially optimal quantity. 

We used the game designed by Holt and Laury (1997) to 
illustrate the concepts of non-rivalry and non-excludabil¬ 
ity and the subsequent market failure rising from the free 
rider problem. From a deck of playing cards, students arc 
each distributed cards. 2 black and 2 red, each. In their 
formulation of the experiment, each student was asked to 
play two cards by putting them on top of a stack in the 
instructor s hand. Students “earned" four dollars for each 
of the red cards that they kept. 'Ihcy also earned a dollar 
for each red card placed in the stack, by themselves or by 
anyone else. Playing a red card amounted to making a con¬ 
tribution to the public good. Black cards did not affect an 
individual’s earnings. This game provided students with 
three choices: 

a. to play two red cards 

b. to play one red and one black card 

c. to play two black cards. 

The game illustrates the principles of non-excludability in 
that individuals cannot be excluded from the benefits of 
contributions and non-rivalry, i.c.. one person’s earnings 
from the group contribution do not reduce anyone elsc’s 
earnings. It also articulates the public goods dilemma 
and the resulting market failure, as, in a given round an 
individual can maximize earnings by not contributing 
but earnings for society as a whole are maximized when 
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Table 1 

Student Profiles by Learning and Teaching Style 


Gender 

Male 

Count Percent 

Female 

Count Percent 







Control 

18 

64.29%' 

10 

35.7/% 







Experimental 

47 

55.95%* 

37 

44.05% 







Total 

65 

58.04%' 

47 

41.96% 








White 

Nonwhitc 







Kace 

Count 

Percent 

Count 

Percent 







Control 

22 

78.57% 

6 

21.43% 







Experimental 

65 

77.38% 

19 

22.62% 







Total 

87 

77.68% 

25 

22.32% 







Major 

Business 

Social Science 

Arts 

Humanities 

Science/ 

Engineering 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Control 

16 

57% 

2 

7% 

2 

7% 

2 

7% 

6 

21.43% 

Experimental 

47 

55.95% 

15 

17.86% 

0 

0% 

3 

3.57% 

16 

19.05% 

Total 

63 

56.25% 

17 

15.18% 

2 

1.79% 

5 

4.46% 

22 

19.64% 


Freshman 

Sophomore 

Junior 

Senior 



Tear 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Count 

Percent 



Control 

7 

25% 

13 

46% 

6 

21% 

2 

7% 



Experimental 

19 

22.62% 

43 

51.19% 

14 

16.67% 

7 

8.33% 



Total 

26 

23.21% 

56 

50.00% 

20 

17.86% 

9 

8.04% 



Learning Sty le 

Visual 

Auditory 

RcadWrite 

Kinesthetic 

Multimodal 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Count 

Percent 

Control 

0 

0% 

6 

21% 

8 

29% 

n 

39% 

3 

10.71% 

Experimental 

11 

13.10% 

26 

34.67% 

13 

15.48% 

24 

28.57% 

10 

11.90% 

Total 

11 

9.82% 

32 

28.57% 

21 

18.75% 

35 

31.25% 

13 

11.61% 


a The percent in each sub-category calculated as a percentage of the total number of students in the control group (28). 
b The percent in each sub-category is calculated as a percentage of the total number of students in the experiment group (84). 
c The percent value in calculated as a percentage of the total number of students in the survey (112). 
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everyone contributes fully. The experiment, thus, allows 
students to visualize the concept of market failure and 
conclude from discussions with the class that society's 
earnings can be maximized only when everyone is com¬ 
pelled to contribute by an outside agency, like the govern¬ 
ment. 

We modified the game by incorporating the use of clickers. 
Instead of physically collecting and returning the cards 
to each student after each round we presented the above 
options to students on a projector and required them to 
choose one of the above three options using clickers. The 
total number of red cards contributed was reported to the 
class after each round. Using clickers not only allowed the 
students to keep their decisions private but also reduced 
the a dcad time* in between rounds that were spent col¬ 
lecting. tabulating and redistributing cards 7 and freed up 
more time for class discussion. Any discussion pertaining 
to the experiment and the applicability of its outcomes to 
the concept of public goods were conducted only after all 
rounds were completed. 

We went through multiple rounds of the experiment and 
also changed the value of a red card in subsequent rounds. 
The expectation is that as “earnings* and therefore net 
benefits from playing a red card decreases, participants 
will be more inclined to play red cards. (See Holt and 
Laury, 1997 for the instruction sheet handed out to the 
students in the experiment class). We measured learning 
outcomes by including 6 multiple choice questions on 
public goods (See Appendix B) in the student survey*. A 
comparison of total points on these provided a measure 


7 Ball. Eckel and Rojas (2006) demonstrate that us¬ 
ing handheld devices and wireless technology facili¬ 
tates the use of experiments in large classes, a fact of 
budget realities. These handheld devices uniquely 
identify students and enable tracking of decisions 
and scores. They assessed the effectiveness of this 
methodology’ using pre and post-test assessments 
and parallel final exams for an experiment classes 
and a control class. Amongst the gains in learning 
outcomes, was a statistically significant difference in 
final exam grades of 3.2 points for the experiment 
group. 

8 Emerson and Taylor (2004) criticize the choice 
of a common set of multiple choice questions 
as a testing instrument due to its susceptibility 
to potential bias. These criticisms arose from 
aspects that were specific to their experiment 
design wherein the majority of instructors writ¬ 
ing the exam taught the control sections. In our 
experiment all sections were taught as well as 
questions designed by the same instructor. 
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the impact of experiment based teaching by student learn- 
ingtype. 


Table 2 

Comparison of 

Learning Outcomes across Groups 


Control 

Group 

(N=28) 

Experiment 

Group 

(N=84) 

Average Total Score*' 

5.39 

5.11 

Average Ql Score K< 

0.93 

0.83 

Average Q2 Score*' 

0.96 

0.98 

Average Q} Score** 

0.86 

0.81 

Average Q4 Score** 

0.82 

0.86 

Average Q5 Scorc*^ 

0.96 

0.86 

Average Q6 Score*' 

0.86 

0.79 

a Out of a maximum of 6 points. 


b Out of a maximum of 1 

point each. 


c The t-statistic shows that the mean values of the con¬ 
trol and experiment group arc not significantly differ¬ 
ent from each other. 

d The t-statistic shows that the mean value of the con¬ 
trol group is significantly greater than the experiment 
group at the 10 % level of significance. 


RESULTS 

Contrary to expectation, the control group scored higher 
in the post experiment questionnaire than the experi¬ 
ment group. A breakdown of the average overall score 
and by question per student in presented in T able 2. Fe¬ 
male students score significantly higher than thdr male 
counterparts in the experiment group, at the 5% level of 
significance whereas nonwhite students score significantly 
less than white students in both control and experiment 
groups at the 5% level of significance. 

We also investigated whether learning outcomes varied 
across learner preferences. Except for multimodal learn¬ 
ers. no learning preference group experienced any learn¬ 
ing gains in the experiment group relative to the control 
group though once again the difference in average scores 
is not significant (see Figure 2). It is worthwhile to note 
that these results could be driven by the heterogeneity in 
the relative weights of learning style in the two groups (see 
Table 1). Figures 1 and 2 show no evidence of gains from 
experiment based learning, unlike in an eaHier study by 
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us that was largely based on univariate analysis. In this pa¬ 
per. we control for student year, ability, cffoit. major and 
previous participation in a similar experiment in addition 
to race, gender and learning preferences. To test for the 
impact of gender, race and learning style preferences on 
learning outcomes (total points) we estimated the follow¬ 
ing equation using the Ordinary Least Squares method. 


Variable descriptions and the results of the regression 
analysis arc presented in Table 3- Model 1 is our basic 
model while Model 2 includes gender, race and learning 
preference interacted with experiment. Model 2 helps 
us to test whether female (male), nonwhitc (white) and 
various learning preferences’ experience learning gains or 
losses relative to the base group in an experiment based 
learning format. Ihc R-squared and adjusted R-squared 



Table 3 

Impact of Race. Gender, Learning and Teaching Styles on Learning Outcomes 

Total Point* 

Variable Definition* 

MODEL 

1 

2 

Experiment 

Class 

Dummy var. equal to 1 if student is in an Experiment Class 

0.36 

(0.30) 

0.58 

(0-95) 

Female 

Dummy var. equal to 1 if gender is Female 

fm 

0.58 

(0.48) 

Nonwhitc 

Dummy var. equal to 1 if student is Nonwhitc 

-0.97 

(0.28)’” 

-1.54 

(0.67)" 

High School 
GPA 

Student High School GI'A 

0.44 

10.25)' 

0.45 

(0.25)' 

Study Hours 

Dummy var. equal to 1 if student studies more than 15 hours per week 

0.17 

(0.46) 

0.04 

(0.46) 

Freshman 

Dummy var. equal to 1 if student is a Freshman 

-0.57 

(0.47) 

-0.53 

(0.48) 

Sophomore 

Dummy var. equal to 1 if student is a Sophomore 

-1.05 

(0.45)" 

-1.1 

(0.46)" 

Junior 

Dummy var. equal to 1 if student is a Junior 

-1.38 

(0.49)— 

-1.43 

(0.48)— 

Econdassl 

Dummy var. equal to 1 if student has taken 1 or more Econ classes 

-0.20 

(0.29) 

-0.14 

(0-3) 

Business 

Dummy var. equal to 1 if student’s major is Business 

0.48 

(0.73) 

0.54 

(0.73) 

Social science 

Dummy var. equal to 1 if student’s major is in the Social Sciences 

1.01 

(0.76) 

1.04 

(0.75) 

Arts 

Dummy var. equal to 1 if student’s major is in the Arts 

0.42 

(Ml) 

0.09 

(1.12) 

Humanities 

Dummy var. equal to 1 if student’s major is in the Humanities 

0.40 

(0.89) 

0.52 

(0.92) 

Science 

Dummy var. equal to 1 if student’s major is in the Sciences or Engineering 

0.07 

(0.76) 

0.16 

(0.76) 


Dummy var. equal to 1 if student participated in Public Goods exp. in a 
previous class 

0.15 

(0.29) 

0.14 

(0.29) 

Kinesthetic 

Dummy var. equal to 1 if the dominant learning type is Kinesthetic 

0.42 

(0-38) 

1.71 

(0.78)" 

Auditory 

Dummy var. equal to 1 if the dominant learning type is Auditory 

0.80 

(0.39)” 

1.52 

(0.93) 

Visual 

Dummy var. equal to 1 if the dominant learning type is Visual 

0.19 

(0.50) 

-0.14 

(0.52) 

RcadWrite 

Dummy var. equal to 1 if the dominant learning type is Readwrite 

0.31 

(0.43) 

0.71 

(0.93) 


Dummy var. equal to 1 if student is a Kinesthetic learner and in an exp. 
class 

- 

-1.82 

(0.89)" 


Dummy var. equal to 1 if student is an Auditory learner and in an exp. class 


-1.04 

(1.03) 


Dummy var. equal to 1 if student is a Visual learner and in an exp. class 


dropped 
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Table 3 

Impact of Race, Gender, Learning and Teaching Styles on Learning Outcomes 

Total Point! 

Variable Definition! 

MODEL 

1 

2 

RcadWritc 

Experiment 

Dummy var. equal to 1 if student is a Readwrite learner and in an exp. class 

- 

-0.63 

(1.05) 

Female 

Experiment 

Dummy var. equal to 1 if student is Female and in an exp. class 

- 

-0.07 

(0.56) 

Nonwhite 

Experiment 

Dummy var. equal to 1 if student is Nonwhitc and in an exp. class 

- 

0.71 

(0-75) 

Constant 


4.12 

(1.15)— 

3.40 

(14)” 

R-squared 


0.3611 

0.4084 

Number of 
observations 


111 

111 

Standard Errors reported in parentheses; "•'significant at 1% ""significant at 5% "significant at 10% 
a This variable is dropped as there arc no visual learners in the control group. 


values in Model 2 arc higher than Model 1 indicating the 
robustness of the Model 2 specification. 

We find that experiment based learning has no significant 
impact on the learning outcomes as measured by the total 
points scored by a student in the post experiment ques¬ 
tionnaire. In fact we find that participating in the experi¬ 
ment has a negative and significant at the 10 % impact on 
the total score in Model 2. This result reinforced to us that 
experiment based learning and active learning techniques 
cannot be adopted in isolation and require a more sub¬ 
stantial shift in teaching methodology. Active learning 
techniques as learning/tcaching tools arc effective only if 
learners get continuous practice at participating in and re¬ 
lating experiment outcomes to economic concepts. Also, 
non-native English speakers may be at a disadvantage in 
processing experiment instructions and understanding 
concepts as this learning technique relics on class discus¬ 
sions and student interaction for the student to success¬ 
fully relate the experiment to theory. 

Female students significantly outperform their male 
counterparts in Model 1. From Model 2 it is evident that 
there is no significant difference in the average perfor¬ 
mance of female students relative to males in an experi¬ 
ment class. Similarly nonwhitc students experience no dif¬ 
ferential gains in learning relative to white students in an 
experiment class. However. nonwhite students score con¬ 
sistently lower than their white classmates. The variable 
nonwhite docs not capture the ethnic and racial diversity 
amongst nonwhitc students, a variable that includes inter¬ 


national students. Minority students' performance could 
be adversely impacted by the absence of a cohort of stu¬ 
dents of similar backgrounds and of significant orienta¬ 
tion and retention programs for minority students. 

In Model 1. auditory learners experience positive and sig¬ 
nificant gains in learning outcomes. They also tend to be 
the highest scorers across both class groups (sec Figure 2). 
Auditory learners learn best from lectures and have a pref¬ 
erence for information that is heard and spoken. In the 
experiment group these students probably benefited from 
the post-experiment discussion while in the control group 
the lecture based format most likely matched their learn¬ 
ing preferences the most. However, auditory learners do 
not experience significant gains from experiment based 
learning, thus the coefficient on the interaction term is 
insignificant. 

In Model 2, kinesthetic learners outperform the base 
group of multimodal learners though kinesthetic learners 
in the experiment class arc worse off by 0.11 points on av¬ 
erage relative to kinesthetic learners in a non-experiment 
class. Ihough we would expect kinesthetic learners to ex¬ 
perience gains from simulated learning, the above results 
suggest that the design and implementation of the experi¬ 
ment did not allow for them to maximize their learning 
potential from the experiment. 

High School GPA, a measure of student ability and effort 
is a significant predictor of the total points scored by the 
student in both models. 
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Sophomores and juniors tend to score significantly lower 
than the base group of seniors. Seniors, potentially, can 
tap into a larger knowledge base of related topics and more 
importantly could have experience with experiment based 
learning enabling them to convcn experiment behavior 
and outcomes to conceptual understanding. 

In analyzing learning outcomes by question (results not 
reported here), we find that students in an experiment 
class score higher than the control group in their respons¬ 
es to question 2 .Qucstion 2 requires students to be able 
to apply the theoretical concepts of non-rivalry and non- 
cxdudability to classifying goods as public or private and 
experiment based learning is superior in providing these 
skills to students relative to the traditional lecture format. 
Ql. Q3-5 are more factual and consist of concept defini- 
tions.Q6 requires students to draw upon their know ledge 
of markets covered in earlier chapters and relate it to the 
topic of public goods. There is no significant difference in 
the performance of the experiment class and the control 
group in this question. 

CONCLUDING REMARKS 

In sum. we find no conclusive evidence of gains from ex¬ 
periment based learning. Race, gender and ability arc the 
most significant predictors of student performance. How¬ 
ever, these findings do not refute the conclusive evidence 
established in the literature that experiment based learn¬ 
ing in particular results in significant gains in learning 
performance of students. Our findings reinforce to us that 
instructors cannot rely on a hybrid teaching technique of 
experiments and lectures, unless they adopt a threshold 
number of experiments based topics. With practice, stu¬ 
dents can be trained to be active participants in experi¬ 
ments, engage in strategic behavior that most experiments 
require and contribute to post-experiment discussion that 
is key to relating the experiment to theory. Therefore, flex¬ 
ibility in curriculum design is a precondition to successful 
use of experiment based learning. 

Our findings also prompt us to make the following chang¬ 
es to our experiment design and research methodology: 

First, we propose to hand out experiment instructions to 
students at least a class in advance so that the disadvan¬ 
tages experienced by non-native English speakers and stu¬ 
dents with learning disabilities arc minimized. 

Second, instead of testing students on learning outcomes 
immediately after the topic w as covered, both in the con¬ 
trol and experiment groups, we propose to test for concept 
retention by students in cither group by testing at least 
two weeks later. 


Journal of Learning in Higher Education 


Third, in the experiment class we propose to minimize 
peer group advantages of some groups (whites for instance) 
by changing class seating through some prc-dctcrmincd 
formula so that students feel equally (dis)advantagcd for 
engagement in the post-experiment discussion. 

Fourth, the post-experiment questions need to be rewrit¬ 
ten to test students not merely on factual knowledge but 
on higher levels of learning as described by Bloom's taxon¬ 
omy. Our questions have to be rewritten to test for com¬ 
prehension and critical thinking. 

Fifth, we propose to recruit more instructors so that our 
study findings can be tested for broad applicability despite 
the consequent variation in instructor methodology. An 
advantage of doing so would be to increase sample size 
both across control and experiment groups, thus decreas¬ 
ing heterogeneity in sub-sample characteristics. 

In conclusion, this study reinforces to us instructors that 
teaching techniques cannot be one size fits all. It also pro¬ 
vides us with the opportunity to statt a conversation with 
our colleagues on the future of Economics teaching in the 
context of increasing classroom diversity, size and techno¬ 
logical advances in education. 
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Appenoix A 

VARK Learning Preference Categories 

Visual (V): 

This preference includes the depiction of information in maps, spider diagrams, charts, graphs, flow charts, labeled 
diagrams, and all the symbolic arrows, circles, hierarchies and other devices that people use to represent what could 
have been presented in words. 

Aural / Auditory (A): 

This perceptual mode describes a preference for information that is “heard or spoken * Students (and teachers) with 
this as their main preference report that they learn best from lectures, group discussion, radio, email, using mobile 
phones, speaking, web-chat and talking things through 
Rcad/writc (R): 

This preference is for information displayed as words. 'Ihis preference emphasizes text-based input and output-read¬ 
ing and writing in all its forms but especially essays, reports and assignments. 

Kinesthetic (K): 

By definition, this modality refers to the “perceptual preference related to the use of experience and practice (simu¬ 
lated or real).* Although such an experience may invoke other modalities, the key is that people w ho prefer this mode 
arc connected to reality, “either through concrete personal experiences, examples, practice or simulation* It includes 
demonstrations, simulations, videos and movies of “real* things, as well as case studies, practice and applications. 
People with this as a strong preference learn from the experience of doing something and they value their own back¬ 
ground of experiences and less so, the experiences of others. 

Multimodals (MM): 

Those w ho do not have a standout mode with one preference score well above other scores arc deflned as multimodal 
They arc of two types. There arc those who arc flexible in their communication preferences and who switch from 
mode to mode depending on what they arc working with. They arc context specific. They choose a single mode to suit 
the occasion or situation. 

Source: & Copyright Version 7.0 (2006) held by Neil D. Fleming, Christchurch. New Zealand and Charles C. Bon- 
wcll, Springfield, MO 65804 
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Appendix B 

Public Goods Questions: Test of Learning Outcomes 

1 . As ic relates to a public good, nonrivalry means that: 

a. the public sector is able to provide the good profitably. 

b. there is no need or demand for the good. 

c. either the public sector or the public sector can produce the good, but not both. 

d. one person's benefit from the good docs not reduce the benefit available to others. 

2 . Which of the following is a public good 

a. A fireworks display. 

b. A hotdog 

c. A barbecue grill 

d. A personal computer 

3. The market system docs not produce public goods because 

a. There is no need or demand for such goods. 

b. Private firms cannot stop consumers who are unwilling to pay for such goods from benefiting from 
them 


c. Public enterprises can produce goods at lower costs than private enterprises. 

d. Their production seriously distorts the production of income. 

4. Non-excludability is the idea that: 

a. government actions cannot remedy market failure. 

b. the presence of external costs and benefits produces a misallocat ton of resources. 

c. individuals cannot recent benefits from a good without paying for it. 

d. individuals who arc unable or unwilling to pay for a good cannot be excluded from the benefits pro¬ 
vided by that product. 

5. The free-rider problem is that: 

a. free public transportation is overcrowded. 

b. people will not voluntarily pay for something that they can obtain without paying. 

c. government supplies goods at no charge to people who can afford to pay for them. 

d. public goods often create large external costs. 

6 . Government rather than private firms must provide economically desirable public goods because: 

a. high marginal costs preclude their production in the private sector. 

b. public goods have characteristics that make it difficult or impossible for private firms to produce them 
profitably. 

c. public goods have marginal costs that exceed marginal benefits. 

d. the law of increasing opportunity costs applies only to private goods. 


48 


Fall 2014 (Volume 10 Issue 2) 





